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Presentation  Roadmap 


Project  Objectives,  Motivation,  and  Goals 


•  Modeling  &  Analysis 

■  Architecture-based  approach 

■  Generic  UML  structural  model 

-  Specific  models  instantiated  with  Architecture  Description  Language 


•  Assessment  of  Architecture-Based  Approach 

•  Overview  of  On-Going  Work 

■  Measuring  responses  of  different  service  discovery  architectures 
to  node  and  link  failures 

■  How  can  these  responses  be  improved? 

•  Plans  for  Future  Work 
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Dynamic  discovery  protocols.. 

enable  network  elements  (including  software  clients  and  services,  and  devices): 

(1 )  to  discover  each  other  without  prior  arrangement, 

(2)  to  express  opportunities  for  collaboration, 

(3)  to  compose  themselves  into  larger  collections  that  cooperate  to  meet 
an  application  need,  and 

(4)  to  detect  and  adapt  to  changes  in  network  topology. 


Selected  Current  (First)  Generation 
Protocols  for  Dynamic  Service  Discovery 
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Our  Goal 


nA04>A 


1 )  Use  ADLs  and  associated  tools  to  analyze  Discovery  Protocol 
specifications  to  assess  consistency  and  completeness  wrt  dynamic 
change  conditions — basis  for  defining  gauges. 

2)  To  provide  metrics  and  approaches  to  compare  and  contrast  emerging 
commercial  service  discovery  technologies  with  regard  to  critical 
functions,  structure,  behavior,  performance  and  scalability  in  the  face  of 
dynamic  change  and  to  strengthen  the  robustness,  quality  and 
correctness  of  designs  for  future  protocols. 

3)  Provide  recommendations  on  improving  ADLs  as  tools  for  analyzing 
architectures  under  conditions  of  dynamic  change. 
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Our  Overall  Technical  Approach 


Build  a  generic,  domain  modei  (UML)  providing  consistent  terminology 
encompassing  a  range  of  service  discovery  protocols. 

Build  executable  models  of  service  discovery  protocols  from  extant 
specifications--for  analysis  under  conditions  of  dynamic  change. 

Define  consistency  conditions  and  metrics  to  assess  the  performance 
of  executable  models. 

Use  scenarios  to  exercise  models  conditions  of  dynamic  change. 
Compare  and  contrast  our  models  with  regard  to  function,  structure, 
behavior,  performance,  complexity,  and  scalability  under  conditions  of 
dynamic  change. 

Design,  model,  and  evaluate  protocol  mechanisms  that  enable 
discovery  protocols  to  self-adapt  in  the  face  of  dynamic  change  (this  part 
of  the  project  is  funded  by  the  DARPA  Fault  Tolerant  Networks  program). 
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Summary  of  Current  Results 


•  Developed  architecture-based  approach  for  modeling  service 
discovery  protocols  that  relies  on 

-  property  analysis  using  consistency  conditions  to  assess  robustness  of 
distributed  software  components  to  dynamic  change 

-  event  analysis  using  explanatory  capabilities  provided  by  ADLs  (Rapide) 

to  analyze  consistency  and  compieteness  of  software  specifications 
under  conditions  of  dynamic  change. 

•  Demonstrated  viability  of  the  approach  to  anaiysis  of  behavior  and 
performance  of  commercial  Service  Discovery  Protocol  specification. 

•  Evaluated  ADLs  for  use  in  modeling  and  analyzing  dynamic  distributed 
systems  and  provided  recommendations 

•  Extended  approach  to  make  quantitative  measurements  of  response  of 
alternative  service  discovery  architectures  to  dynamic  change 
(currently  being  applied  in  ongoing  study). 
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Presentation  Roadmap 


•  Project  Objectives,  Motivation,  and  Goals 


Modeling  &  Analysis 

■  Architecture-based  approach 

■  Generic  UML  structural  model 

-  Specific  models  instantiated  with  Architecture  Description  Language 


•  Assessment  of  Architecture-Based  Approach 

•  Overview  of  On-Going  Work 

■  Measuring  responses  of  different  service  discovery  architectures 
to  node  and  link  failures 

■  How  can  these  responses  be  improved? 

•  Plans  for  Future  Work 
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Sample  Network  Topology  Applicable  to  JInl  Entitles 
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Foundation  :  A  Generic  Structurai  Modei  (UML)  for 

Service-Discovery  Domain 
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Architectural  Description  Languages  &  Toois.... 

•  Represent  essential  complexity  of  service  discovery  protocois 
with  effective  abstractions 

-  Rapide,  public-domain  ADL  and  toolset  developed  at  Stanford 
University  for  DARPA,  provides  ability  to  execute  architecture 
specifications,  producing  Partially  Ordered  Sets  of  Events  (POSETs) 
for  analysis. 

•  Provide  a  framework  and  context 

-  to  define  metrics  that  yield  qualitative  and  quantitative  measures  of 
dynamic  component-based  software 

-  to  model  alternate  approaches  to  specific  functions  or  mechanisms 

-  to  help  pinpoint  where  inconsistencies  and  ambiguities  may  exist 
within  software  implementing  specifications  &  to  understand  how  such 
issues  arise 

-  to  compare  and  contrast  dynamic  service  discovery  architectures 
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Architecture-based  Approach  to  Modeling  and  Analysis 

(using  Rapide,  an  Architecture  Description  Language  and  Toois 

Deveioped  for  DARPA  by  Stanford) 


Time 
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5 
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__!|«*************************************************** 

-**3.3  DIRECTED  DISCOVERY  CLIENT  INTERFACE  ** 

—  This  is  used  by  all  JINI  entities  in  directed 

—  discovery  mode.  It  is  part  of  the  SCM  Discovery 

-  Module.  Sends  Unicast  messages  to  SCMs  on  list  of 

-  SCMS  to  be  discovered  until  all  SCMS  are  found. 

—  Receives  updates  from  SCM  DB  of  discovered  SCMs  and 

-  removes  SCMs  accordingly 

—  NOTE:  Failure  and  recovery  behavior  are  not 

-  yet  defined  and  need  reviw. 

TYPE  Directed  Discovery  Client 

(SourcelD  :  IP  Address;  InSCMsToDiscover  :  SCMList;  StartOption  :  DD  Code; 
InRequestInterval :  TimeUnit;  InMaxNnmTries  :  integer;  InPV  :  ProtocolVersion) 

IS  INTERFACE 

SERVICE  DDC  SEND  DIR  :  DIRECTED  2  STEP  PROTOCOL; 

SERVICE  DISC  MODES  :  dual  SCM  DISCOVERY  MODES; 

SERVICE  DD  SCM  Update  :  DD  SCM  Update; 

SERVICE  SCM  Update  :  SCM  Update; 

SERVICE  DB  Update  :  dual  DB  Update; 

SERVICE  NODE  FAILURES  :  NODE  FAILURES;  -  events  for  failure  and  recovery. 
ACTION 

IN  Send  RequestsO, 

BeginDirectedDiscoveryO; 

BEHAVIOR 

action  animation  lam  (name:  string); 

MySourcelD  :  VAR  IP  Address; 

PV  :  VAR  ProtocolVersion; 
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For  All  (SM,  SD,  SCM): 

(SM,  SD)  IsElementOf  SCM  registered-services 
implies  SCM  IsElementOf  SM  discovered-SCMs 

For  All  (SM,  SD,  SCM): 

SCM  IsElementOf  SM  discovered-SCMs  & 

(SD)  IsElementOf  SM  managed-services 
implies  (SM,  SD)  IsElementOf  SCM  registered-services 
For  All  (SM,  SD,  SCM): 

SCM  IsElementOf  SM  discovered-SCMs  & 

(SM,  SD)  IsElementOf  SCM  registered-services  & 

NOT  (SCM  IsElementOf  SM  persistent-list) 

implies  Intersection  (SM  GroupsToJoin,  SCM  GroupsMemberOf) 

For  All  (SM,  SD,  SCM,  SU,  NR): 

(SU,  NR)  IsElementOf  SCM  requested-notifications  & 

(SM,  SD)  IsElementOf  SCM  registered-services  & 

Matches((SM,  SD),  (SU,NR)) 
implies  (SM,  SD)  IsElementOf  SU  matched -services 
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Layered  View  of  Prototype  JINI  Architecture  in  Rapide 

Derived  from  SEI  Architectural  Layers  Approach 
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Real-Time  Checking  of  Consistency  Conditions 


Sample  Consistency  Condition  (CC  #4  race  condition) 

For  All  (SM,  SD,  SCM,  SU,  NR): 

(SU,  NR)  IsElementOf  SCM  requested-notifications  & 

(SM,  SD)  IsElementOf  SCM  registered-services  & 

Matches  ((SM,  SD),  (SU,  NR)) 

Implies  (SM,  SD)  IsElementOf  (S\J  matched-services) 

...that  is,  if  an  SU  has  requested  notification  with  a  Service  Cache  Manager  of  a 
service  that  matches  a  service  description  registered  by  a  Service  Manager  on 
the  same  Cache  Manager,  then  that  service  description  should  be  provided  to  the 
Service  User. 


Assuming  absence  of  network  failure  and  normal  delays  due  to  updates 


•  SM  is  Service  Manager 

•  SD  is  Service  Description 

•  SCM  is  Service  Cache  Manager 

•  SU  is  Service  User 

•  NR  is  Notification  Request 


•  requested-notifications  is  a  set  of  (SU,NR)  pairs 
maintained  by  the  SCM 

•  registered-services  is  a  set  of  (SM,SD)  pairs 
maintained  by  the  SCM 

•  matched-services  is  the  set  of  (SM,SD)  pairs 
maintained  by  the  SU 
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Use  of  Property  and  Event  Analysis  to  Identify  and 
Understand  Possible  Registration  Race  Condition 
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implies  (SM,  SD)  IsElementOf  SU  matched-services 
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Presentation  Roadmap 

•  Project  Objectives,  Motivation,  and  Goals 

•  Modeling  &  Analysis 

■  Architecture-based  approach 

■  Generic  UML  structural  model 

-  Specific  models  instantiated  with  Architecture  Description  Language 
Assessment  of  Architecture-Based  Approach 


•  Overview  of  On-Going  Work 

■  Measuring  responses  of  different  service  discovery  architectures 
to  node  and  link  failures 

■  How  can  these  responses  be  improved? 

•  Plans  for  Future  Work 
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Assessment  of  Architecture-Based  Approach 


•  Used  approach  to  verify  robustness  of  Jini  Protocol 
under  variety  of  failure  scenarios 

•  Merits  of  approach  for  analysis  of  dynamic  behavior 

-  Architectural  model  allowed  easier  representation  of  discovery 
components  and  their  behavior:  more  precise,  concise  and 
informative. 

-  Provided  insight  into,  and  understanding  of,  coliective  behavior 
of  interacting  components  than  could  static  specification 

-  Abie  to  identify  areas  of  ambiguity,  inconsistency,  and 
incompieteness  (reported  4  instances) 

-  Singie  modei  can  be  anaiyzed  for  behavior,  performance  and 
iogicai  properties 

-  Aiiowed  alternative  impiementation  options  to  be  considered 
and  expiored  using  realistic  scenarios 
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Assessment  of  Architecture-Based  Approach  (con’t) 


•  Areas  for  Improvement 

-  Improvements  to  representation  of  structure 

•  Benefits  of  using  first-class  connectors 

•  Relaxation  of  strictly  hierarchical  connectivity 

-  Greater  fidelity  to  real-world  designs 

-  Fewer  events  in  POSET 

-  Improvements  to  representation  of  behavior 

•  Explicit  definition  of  component  state  (through  export  of 
selected  state  variables)  --  on  par  with  definition  of  events 

•  Evaluation  of  consistency  conditions  against  state(s)  across 
multiple  components 

•  Linkage  of  events  to  state 

-  Need  for  customizable  domain-specific  syntax 

•  Improve  understandability  of  ADL  specifications  to  non¬ 
specialists  w/  customizable  domain-specific  syntax. 
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Presentation  Roadmap 


•  Project  Objectives,  Motivation,  and  Goals 


•  Modeling  &  Analysis 

■  Architecture-based  approach 

■  Generic  UML  structural  model 

-  Specific  models  instantiated  with  Architecture  Description  Language 


•  Assessment  of  Architecture-Based  Approach 


Overview  of  On-Going  Work 

■  Developing  metrics  to  measure  responses  of  different  service 
discovery  architectures  to  node  and  communication  failures 

■  How  can  these  responses  be  improved? 


•  Plans  for  Future  Work 
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Focus:  How  do  Two-  and  Three-Party  Architectures 
for  Service  Discovery  Respond  to  Faiiures? 


•  Two-Party  vs.  Three-Party  architectures 

Two  alternative  architectural  designs  that  underlie  commercial  service 

discovery  protocols,  including  Jini,  UPnP,  and  Service  Location  Protocol 

•  Impact  of  Study: 

1 .  Develop  and  formalize  metrics  and  related  generic  set  of  test 
scenarios  that  can  be  used  to  develop  and  test  service  discovery 
products/applications 

2.  Continue  to  provide  recommendations  on  improving  ADLs 

3.  Provide  valuable  information  to  designers  and  users  of  service 
discovery  protocols  for  improving  specifications,  thus  promoting 
software  quality  and  reliability. 
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Selected  Current  (First)  Generation 
Protocols  for  Dynamic  Service  Discovery 
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How  Do  Service  Discovery  Architectures  Propagate 
Changes  During  Communication  Faiiures? 


Change  Propagation  and  Consistency  Maintenance:  In  both  two-party 
and  three-party  architectures  changes  in  critical  characteristics  of  Service 
Descriptions  (SDs)  must  propagate  from  Service  Managers  (SMs)  to 
Service  Users  (SUs)  that  already  hold  copies  of  the  SDs. 

•  Change  propagation  may  take  place  through  polling,  eventing,  or  ad- 
hoc  announcements  -  How  do  these  strategies  compare? 

•  Does  the  existence  of  a  third  party  (i.e..  Service  Cache  Manager,  or 
SCM)  improve  or  hinder  performance? 

Approach  to  metrics:  use  property  anaiysis  and  failure  test  scenarios 
to  compare  and  contrast  the  alternative  architectures  wrt 

•  Probability  of  residual  inconsistency  -  probability  that  SM^(SDj)  not 
equal  to  SUj(SDj)  for  a  specific  i,  j,  k  within  a  target  time  bound. 

•  Change  propagation  latency  -  time  delay  from  [SM^(SDj)  not  equal  to 
SUj(SD)]  until  lSMf^(SD)  equal  to  SU/SD)] 

•  Change  propagation  overhead  -  number  of  messages  in  interval 
from  [SMi^(SDj)  not  equal  to  SUj(SDj)]  until  [SMi^(SDj)  equal  to  SUj(SDj)] 

Use  event  analysis  to  understand  why  different  architectures  and 
consistency  maintenance  strategies  vary 
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How  Do  Service  Discovery  Architectures  Recover 
Consistency  After  Communication  and  Node  Faiiures? 

Discovery  and  Recovery:  In  both  two-party  and  three-party  architectures, 
SMs,  SUs,  and  SCMs  (where  applicable)  strive  to  maintain  consistent 
descriptions  (SDs)  about  discovered  services  and  about  event  notifications. 
Link  and  node  failures  may  lead  to  temporary  loss  of  information  about 
discovered  services.  Once  failures  are  repaired,  the  information  must  be 
recovered. 

We  seek  to  develop  metrics  to  compare  and  contrast  different  service- 
discovery  architectures  and  specifications.  For  example: 

•  How  do  discovery  latencies  and  overheads  compare? 

•  How  do  event  registration  latencies  and  overheads  compare? 

•  How  do  recovery  latencies  and  overheads  compare? 
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Presentation  Roadmap 

•  Project  Objectives,  Motivation,  and  Goals 

•  Modeling  &  Analysis 

■  Architecture-based  approach 

■  Generic  UML  structural  model 

-  Specific  models  instantiated  with  Architecture  Description  Language 

•  Assessment  of  Architecture-Based  Approach 

•  Overview  of  On-Going  Work 

■  Measuring  responses  of  different  service  discovery  architectures 
to  node  and  link  failures 

■  How  can  these  responses  be  improved? 

Plans  for  Future  Work 
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Extending  UML  Model  to  Encompass 
Message  Exchanges  and  Assertions 


m 


SERVICE  MANAGER 
liscover  Network  Context() 

:not  shr»  Cache  Manager  Discovery () 

:<OPT»  Announce  Service  Processing() 

)t  shr»  start  Renewal  Task() 
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SERVICE  USER 

^discover  Network  Context() 

WService  Discovery () 

IB«not  shr»  start  Renewal  Task() 
^Service  User() 

«repository  entry  » 
Notification  Request 


«repository  entry  » 
Parameter  Notification  Request 


LOCAL  CACHE  MANAGER 

1 

«repository  » 
Service  Cache 

^^tart  Aging  Task() 

+  Message  Set 
+  Consistency  Conditions 
and  other  assertions 

that  capture  commonality  and 
variability  in  Service  Discovery 
Domain 


>  Reformulate  Rapide-based  models  in  terms  of  this 
generic  model  of  structure  and  behavior 

>  Using  this  model  as  a  basiSt  develop  metrics  for  more  precise 
assessment  of  Service  Discovery  Architectures  and  assist 

in  deveiopment  of  future  speoifioations  and  new  designsm 
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Investigating  Metrics  and  Use  of  Architectural 
Models  to  Measure  System  Complexity 


•  Using  the  unified  architectural  model,  augment  basic  set  of 
metrics  by  creating  representations  of  complexity  metrics 
proposed  in  the  literature,  such  as 

■  algorithmic  information  complexity  [Gammerman  and  Vovk] 
[Kolmogorov],  [Solomonoff] 

■  cyclomatic  complexity  [McCabe] 

■  others  (to  be  selected) 


1/31/2002 


26 


Nisr 

National  Institute  of  Standards  and  Technology 

Technology  Administration,  US,  Department  of  Commerce 


NtST  CENTENNIAL 


To  Delve  More  Deeply 


Currently  Available  Paper 

•  Christopher  Dabrowski  and  Kevin  Mills,  “Analyzing  Properties  and 
Behavior  of  Service  Discovery  Protocols  using  an  Architecture-based 
Approach”,  accepted  at  DARPA-sponsored  Working  Conference  on 
Complex  and  Dynamic  Systems  Architecture. 

Available  Software  Artifacts 

•  Generic  UML  Structural  Model  (in  Rational  Rose  format)  of 

Discovery  Protocols,  including  specific  projections  to  Jini,  UPnP,  and  SLP 

•  Rapide  Models  of  Jini  and  UPnP  {in  progress). 

•  SLX  Simulation  Model  of  UPnP  (in  progress). 

Related  Web  Sites 

•  http://www.itl.nist.qov/div897/ctq/adl/sdp  proiectpaqe.html 

*  http://w3.antd.nist.qov/net  pc.shtml 
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